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MTCTHOD AVm APPARATUS FOR M ULTIPURPOSE 
MONITORING SYSTEM 



5 Field of the Invention 

The present invention relates to the field of target detection system. More 
particularly, the invention relates to a method and apparatus for detecting 
a foreign object in the region of a monitored environment, an object which 
may be unsafe or can pose a threat to said environment, such as a foreign 

10 object in the proximity of airport runways, mihtary bases, homes, 
industrial premises etc. For example, a foreign object in the area of airport 
nmways may interfere with aircraft take-off and/or landing paths and 
endanger aircraft using said paths. 



IS Background of the Invention 

In a multipHcity of environments it is desirable to prevent, eliminate or 
reduce the existence and/or the intervention of foreign objects. Such types 
of environment can be airport runways, xnilitary bases, home indxistrial 
premises etc. A foreign object can be a person, wildlife, birds, inanimate 

20 objects, vehicles, fire etc. 



For s example, in almost every airfield area Foreign Object Debris (FOD) 
are a major treat to aircraft during take-off fi:om a runway or landing on a 
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1^ runway. FOD such as birds, wildlife or any other object on the runway 

region or in the air, can be easily sucked into the jet engine of an aircraft, 
and thereby c€Ui cause a more or less severe damage to the jet engine or to 
the air craft body. Furthermore, in the worst case a bird or other FOD that 
5 has been sucked into a jet engine might cause a crash of the aircraft. 

Several attempts to reduce the risk of collision with birds and other 
wildlife have been made by airport staff, such as frightening the birds with 
noisy bird scare devices and/or shooting them. However, in order to carry 
10 out such attempts, the birds must be spotted in the enviipimQnt of the 
runways. Unfortxmately, birds are hard to detect by human eyes, they are 
difficult and sometimes impossible to detect during the day, and are nearly 
invisible targets for planes at night or during low visibility. 

15 A variety of attempts to control the bird hazard on the airfield have been 
made. However, such controls provide only a partial solution. An airfield 
check has to be done several times per hour in order to detect and deter 
any birds in the airfield areas. The means used for deterring birds include 
vehicle/human presence, pyrotechnics, and the periodic use of a trained 

20 border collie. Furthermore, airport staff is also shifting wildlife by 
eliminating the existence of nourishment sources such as specific type of 
plant, puddle, specific bugs etc., which usually attracts the wildlife. 
However, such nourishment sovirces in the airport area are relatively hard 
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to detect, its required to patrol the airport area with high frequently in 
order eliminate such soxirces. 

JP 2,001,148,011 discloses a small animal detecting method and a small 
5 animal detecting device which can judge an intruder, a small animal, an 
insect, etc., by an image recognizing means on the basis of image data 
picked up by a camera. However, this patent refers only to the detection of 
moving objects that intrudes into the monitored area. Furthermore, it does 
not provide a method to reduce or eliminate from the small animal to stop 
10 intruding in the future. 

US 3,811,010 discloses an intrusion detection apparatus employing two 
spaced-apart TV cameras having lines of observation which intersect to 
form a three dimensional monitored locale of interest and a TV monitor 
15 having a display tube and connected to respond to output signals from said 
TV cameras. The cameras and monitors being synchronized to identify the 
presence and location of an intruder object in said locale of interest. In 
anotiier aspect the invention comparator-adder analyzing circuitry is 
provided between the cameras and monitor such that the monitor is 
20 actuated only when the video from both cameras is identical at a given 
instant. Assuming each camera is directed to observe a different 
background and that the focus is acUusted to substantiaUy eUminate 
background signals, then only signals from the intruder object are 
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5 



10 



observed and it is observed only m the monitored locale. However, this 
patent detects only intrusion objects and it is not directed to static or 
inanimate objects, and it does not provide the foreseen intruder path, the 
intruder size, and other useful parameters. 

AU the methods described above, however, have not yet provided 
satisfectory solutions to the problem of detecting dangerous objects in the 
monitored area, whether they are static or dynamic, and a way to reduce 
or eliminate future mtrusion of those objects to the monitored area. 

It is an object of the present invention to provide a method and apparatus 
for continuously and automatically detecting the presence of birds, wildlife 
and of any other FODs that may constitute a menace to the monitored 



area. 



15 



20 



It is anotiier object of this invention to evaluate the degree of danger posed 
by any detected object. 

It is a furtiier object of this invention to monitor the path of the detected 
dangerous objects and to predict, insofar as possible, their future patii. 

It is> a still furtiier object of tiiis invention to evaluate tiie probabihty of 
collision between of tiie detected dangerous objects and any aircraft 
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expected to take off from or land in the airfield in which the system of the 



invention is installed. 

It is a still further object of this invention to give the alarm as to any 
5 danger revealed from the detection and the monitoring of dangerous 
objects and from the elaboration of the data acquired from said detection 
and monitoring. 

It is a still further object of this invention to determine, insofar a possible, 
10 ways and means for avoiding dangers so revealed and to commxmicate 
them to responsible personnel. 

It is yet -a further object of the present invention to provide solution for 
ehminating future intrusion attempts of wildlife and birds. 

15 

Other objects and advantages of this invention will become apparent as 
the description proceeds. 

While the embodiments of the invention are mainly described with 
20 reference to application in airfields, they, of course, also can be used for 
other applications where there might be a possible problem of intrusion of 
persons., dangerous objects and/or vehicles into ' monitored areas, which 
usually are restricted. It is to be kept in mind that the possibility exists 
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that dai^rous objects may also not be natural ones, such as birds, but 
artificial ones, used for sabotage or t«rtor operations, or a fire endangered 

the monitored area, 

5 IbB airm* taking off or landing on the airfield, and vehicles or persons 
that aUowed to be at the monitored area wiU be designated hereinafter as 
"authorized bodies". AU such birds, wildlife, persons, static objects, 
artificial objects, fire and any other FODs will generally be called 
"dangeroxis objects". 



10 



Pi,«.v»ovY of the Invention 

The method of the invention comprises the steps of: 

a) procuring, adjourning and storing in a memory files representing the 
space above and in the vicinity of the monitored area that is to be 

i5 submitted to continued observation for the detection of dangerous 
objects and the monitoring of their paths (which space will be called 
hereinafter "Mihe controlled space"), wherein said controlled space is 
represented as free from any unexpected and unauthorized bodies and 
is therefore "the background space"; 

20 b) defining and storing in a distal memory programs for processing data 
obtained from the observation of objects, for identifying said objects and 
determining, by the appHcation of danger parameters, whether they 
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- are dangerous, wherein said dangerous parameters are tiie object siz^^ 

location direction and speed of movement; 
c) determiningandstoringparametersaccordingtowhichtheobservation 

of the controUed space is effected, such as different angles, succession, 
5 frequency, resolution, and so forth. Said space may be divided into 
zones of different priorities, viz. zones in which the observation is 
carried out according to different observation parameters; 
d) carrying out photographic observation of the controlled space or 
sections thereof, according to the aforesaid observation parameters; 
10 e) processing the digital data representuxg said photographs, to determine 
whether possible dangerous objects have been detected, and if so. 
classifying said objects accordmg to tiie stored danger parameters; 
f) changing the sections of fee said photographic observation so as to 
monitor the path of any detected dangerous objects; 
15 g) receiving and storing tiie data defining the positions and tixe foreseen 
future path of all authorized bodies; 

h) extrapolating th« data obtained by monitoring the path of any detected 
dangerous objects to determine an assumed future path of said objects; 

i) comparatively processing said assumed future path «ith the foreseen 
20 fliture path of all aua«.rized bodies, to determine the possible danger of 

coUision or intrusion; 
j) optionally, and if posable. determining an ftction on the dange«mB 
objects, such as their possible destruction or a change in their assumed 
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future path, or an action on the authorized bodies, such as delaying 
their landing or take-off or changing their landing or take-off path, that 
vinll eliminate the danger of collision or intrusion; and 
k) optionally, giving alarms to responsible persomxel. or general alarms, in 
any convenient manner and whenever pertinent information is 
acquired, particularly signaling the presence and nature of any 
dangerous objects, the danger of collisions or intrusion and possible 
desirable preventive actions. 

According to a preferred embodiment of the invention, the method farmer 
comprises documenting ihe data obtained from the observation of objects, 
for future prevention acts. Preferably, the future prevention acts are 
eliminating the existence of nourishment sources. 

The apparatus according to the invention comprises: 

a) photographic devices for carrying out photographic observation of the 
controUed space or sections thereof, according to the aforesaid 
observation parameters, wherein said devices can be one or more CCD 
camera and/or one or more Infra Red OR) cameras; 
0 b) a set of motors for changing the sections of the said photographic 

observatioii; 

c) a computer for proces^ng the digital data representing said 
photographs; and 
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d) a memory means for storing said photographs and the processed digital 



The memory means may comprise various memories or a single memory 
5 having different addresses and both possibihties should be always 
understood hereinafter. 

Brief Description of the Drawings 
In the drawings: 

10 - Fig. 1 schematically illustrates a rrmway monitoring system, according to 
a preferred embodiment of the invention; 

- Fig. 2 schematically illustrates in a graph form a method of 
photographing the sequence of photos; 

- Fig. 3 is a flow diart that shows the algorithm of a system for monitoring 
15 the runway; 

- Pig. 4 schematically illustrates the data processing of the algorithm of 



- Fig. 5A schematically illustrates the detection of moving objects in the 
data processing of Fig. 4; 
20 - Fig. 5B schematically illustrates the detection of static objects in the data 
processing of Fig. 4; and 



data. 



Fig. 3; 



- Pig. 6 schematically illustrates in a graph form the threshold level used 



for the detection of moving and static objects. 
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Detaaed Description of Preferr ed Embodiments 

All the processing of this invention is digital processing. Taking a 



5 generates a sample image on the focal plane, which sampled image is 
preferably, but not limitatively, a two-dimensional array of pixels, wherein 
to each pixel is associated a value that represents the radiation intensity 
value of the corresponding point of the image. For example, the radiation 
intensity value of a pixel may be from 0 to 255 in gray scale, wherein 0 = 

10 black, 255 = white, and others value between 0 to 255 represent different 
level of gray. The two-dimensional array of pixels, therefore, is represented 
by a matrix consisting of an array of radiation intensity values. 
Hereinafter, when a photo is mentioned, it should be understood that 
reference is made not to the image generated by a camera, but to the 

1 5 corresponding matrix of pixel radiation intensities. 

Determination of the backgrotmd space 

To determine the backgroimd space, the controlled space must be firstly 
defined. For this purpose, a grotxnd area and a vertical space must be 
20 initially defined for each desirable area to be monitored, such as runway 
and other airfield portions that it is desired to control, boundaries of a 
military base, private gardens etc.; photographic parameters for fully 
representing said area and space must be determined and memorized; a 



photograph by a camera, such as those of the apparatus of this invention. 
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series of photograplis according to said parameters must be taken; and the 
digital files representing said photographs must be memorized. Each time 
said area and said space are photographed and no extraneous objects are 
foimd, an updated version of said area and space - viz. of the controlled 

5 space for each monitored area portion - is obtained. Said parameters, 
according to which the photographs must be taken, generally include, e.g., 
the succession of the photographs, the space each of them covers, the time 
limits of groups of successive photo, the different singles at which a same 
space is photographed, the scale and resolution of the photos succession, 

10 and the priority of different spaces, if such exist. 



Objects evaluation programs 

Programs for identifying objects and classifying them as relevant must be 
defined as integral part of the system of the invention and must be stored 

15 in an electronic memory or memory address. Other programs (evaluation 
programs) must be similarly stored as integral part of the system of the 
invention to process the data identifying each releviant object and 
classifying it as dangerous or not, according to certain parameters. Some 
parameters may be, e.g., the size of the body, its apparent density, the 

20 presence of dangerous mechanical featiu*es, its speed, or the 
xmpredictability of its path, and so on. The same programs should permit 
to classify the possibly dangerous objects according to the type and degree 
of danger they pose: for instance, a body that may cause merely superficial 
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damage to an aircraft will be classified differently from one that may cause 
a crash. The evaluation programs should be periodically updated, taking 
into consideration, among other things, the changes in the aircraft, vehicle 
etc. that may be menaced by the objects and so on. 



Path of authorized bodies 

The paths that authorized bodies will follow when taking-off or landing or 
the path of a patrol aroimd a restricted area, are, of course, known, though 
not always with absolute certainty and precision. Whenever such paths 

10 are reqtiired. during the detection process, they are identified in files stored 
in an electronic memory or memory address, in such a way that computer 
means may calculate the position of each aircraft (in plan and elevation) or 
each patrol at any time after an initial time. For example, in an airfield 
area said paths may be calciilated according to the features of the aircraft 

15 and the expected take-off and landing procedxire, with adjustments due to 
weather conditions. 

Extrapolation of the monitored paths of dangerous objects 
It would be extremely desirable to be able to determine, whenever 
20 required, from the data obtained by monitoring the paths of dangerous 
objects, their futxire progress and the position they will have at any given 
future time. Unfortunately, tins will not be possible for many such objects. 
If the body is a living creature, such as a bird, it may change its path 



5 
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^^ capriciously. Only the paths of birds engaged in a seasonal migration may 
be foreseen to some extent. likewise, other objects may be strongly 
affected by winds. This means that the extrapolation of the monitored 
paths will include safety coefficients and may lead to a plurality of 
5 extrapolated paths, some more probable than others. 

Documentation 

It would be also extremely desirable to be able to eliminate and/or reduce 
the wildlife and the birds population in some monitored area, such as in 

10 the airport area. Therefore, according to a preferred embodiment of the 
present invention, the activities of the wildlife and the birds at that area 
are documented and stored in an electronic memory or memory address 
related to the system of the present invention. The documentation analysis 
can help to eliminate or reduce the wildlife and birds population in the 

15 monitored area in several ways. For example, it can help detect whether 
there exist a nourishment soxirces, such as a specific type of plant, water or 
food in the airport area that attract wildlife or birds, then by eliminating 
that nourishment sources from the airport area, it may reduce or eliminate 
that wildlife and birds from approaching and entering the airport area. 



20 



Estimating possible dangers of collision 

Once the paths of all authorized bodies are known and ttie paths of 
dangerous objects have been extrapolated as well as possible, it is a simple 
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matter of calculation^ easily within the purview of skilled persons, to 
assess the possible dangers of collision. 

Actions for elii y^iTifltiTipr the danger of collision 
5 Such actions may be carried out on the dangerous objects, and in that case 
they are their destruction or a change in their assxmied future path: in 
case of birds, they may be scared off out of the surrounding of the 
monitored area. If they are actions on the authorized bodies, they may be 
delajdng — if not denjdng • their landing or take-off or changing their 

10 landing or take-off path. Such actions are outside the system of the 
invention and should be carried out by the airfield or airline authorities; 
however the system will alert said authorities to the danger of collision 
and at least suggest possible ways of eliminating it and/or the system wiU 
generates an output signal for automatically operating wildlife scaring 

15 devices. It should be emphasized that the time available for such actions is 
generally very short, and therefore the input of the system of the invention 
should be quick, precise and dear. 

An embodiment of an apparatus according to the invention will now be 
20 described by way of example. 



Fig.N 1 schematically illustrates a monitoring system 10, according to a 
preferred embodiment of the invention. System 10 comprises at least one 
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Charged Coupled Device (CCD) camera 12, and/or at least one thermal 
camera 11 (i.e.. Infra Red camera), motors 13 and a computerized system 
15. The CCD camera can provide either color image or imcolored image. 

5 The computerized system 15 is responsible for performing the processing 
required for the operation of this invention as described hereinabove. The 
computerized system 15 receives, at its inputs, data j&rom active cameras 
that are attached to system 10 (e.g., CCD camera 11, thermal camera 12 
etc.). The data from the cameras is captured and digitized at the 

10 computerized system 15 by a frame grabber unit 16. As aforementioned, 
the computerized system 15 processes the received data from the cameras 
in order to detect, in real-time, dangerous objects at the mordtored area. 
The processing is controlled by controller 151 according to a set of 
instructions and data regarding the backgroimd space, which is stored 

15 within the memory 151. The computerized system 15 outputs data 
regarding the detection of suspected dangerous objects to be displayed on 
one or more monitors, such, as monitor 18, via its video card 17 and/or to 
notified other systems by communication signals 191 that are generated 
from commimication unit 19, such as signals for a wildlife scaring device, 

20 airport operator static computers, wireless signals for portable computers 
etc. 
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One or more of the cameras attached to system 10 is rotated by motors 13 
horizontally (i.e., pan) and/or vertically (i.e., tilt). Typically, the motors 13 
are servomotors, Tlie rotation of the cameras is required for scanning the 
specific runway environment. In order to determine the angle of the 

5 camera, two additional elements are provided to each axis that rotates a 
camera, an encoder and a reset reference sensor (both elements shown as 
imit 131 in Fig. 1). The reset sensor provides, to the computerized system 
15, the initiation angle of the camera at the beginning of the sca nnin g, and 
the encoder provides, to the computerized system 15, the current angle of 

10 the camera during the scanning. Motion controller 14 controls motors 13 
and in addition it also controls the zoom capabilities of the attached 
cameras, such as cameras 11 and 12. Motion controller 14 can be located 
within the computerized system 15 or it can remotely communicate with it. 
Motion controller 14 communicates with the attached cameras and the 

15 computerized system 15 by a suitable communication protocol, such as RS- 
232. 

According to a preferred embodiment of the present invention, each 
camera attadied to the system 10 constantly scans a portion or the entire 
20 environment. For a t3^ical camera model (e.g., Raytheon commercial 
infrared series 2000B controller infrared thermal imaging video camera, of 
Raytheon Company, U.S.), which is suitable to be attached to system 10, it 
takes about 15 seconds to scan, the complete runway environment that is 
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covered by it. The scanning is divided into several and a constant number 
of tracks, upon which each camera is focused. The preferred scanning area 
is preformed at tixe area ground up to a height of. preferably but 
hmitatively, two hundred meters above the area ground and also at a 
distance of a few Idlometers, preferably 1 to 2 Km, towards the horizon. 
Preferably but hmitatively, the cameras of system 10 are installed on a 
tower (e.g., flight control tower) or on other suitable pole or stand, at a 
height of between 25 to 60 meters above the desired monitored area 
ground. 



10 



The cameras can be configured in a variety of ways and positions. 
According to one preferred embodiment of the invention, a pair of identical 
camerasis located verticaUy one above the other on the same pole, so that 

the distance between the cameras is approximately between 1 to 2 meters. 
15 The pole on which the camera are located can be a pivot by a motor, thus 

on each turn of the pole, both of the cameras are moved together 

horizontally. In such a configuration the cameras scans a sector, track or 

zone simultaneously. 

20 Big. 2 schematioally fllusteates in a graph form an example for the method 
of photographing a sequence of photos of the environment by system 10 
(Kg. 1). a«»rding to a preferred embodiment of the invention. At each new 

angle of the camera attached to system 10, several photos are taken. 
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preferably, about 80 photoa. The angle of the camera is modified before 
each photo or se<p.ence of photos is taken by motors 13 and motor 
c«.troller 14. as described hereinbefcre. At the same time when the 
modification occurs, the camera zoom is changed, by the computerized 
5 system 15. in accordance with range of the scanned section. The time it 
takes for the camera to change its current angle to a new angje position is 
shown by item 21 and it refers to the time fcom tl to t2. which is 
preferably but not limitatively less than 300 msec. After obtaining the new 
angle, the camera tekes the sequence of photos (shown by item 22) at a 
10 time period, which should be as short as possible, preferably, shorter than 
one second (i.e., the time firom t2 to t3). Finally, at the time period from t3 
to t4, two things happen: 

- firstly, the data of the last taken photo or sequence of photos is 

processed by the computerized system 15, and 
15 - secondly, items 21 and 22 are repeated, but the camera is now at its 

new angle. 

The aforementioned acta are repeated constantly atong and above the 
desirable monitored area, which is covered by the camera. The scanning of 
the environment by each camera is performed either continuously or in 
20 segments. 

Of course, when using at least two CCD cameras ^ of which are located 
at same view angles but at a distance from ea«h other and/or at least two 
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iBfra Red cameras each of which are located at the same view angles but 
also at a distance from each other, additional details on a suspected 
dangerous objects can be acquired. For e^ple, the additional details can 

be the distance of the object from the cameras, the relative spatial location 
5 of the object at monitored area, the size of the object ete. Using a smgle 
camera result in a two-dimension (2-D) photo, which provides less details, 
but when using, in combination. 2-0 photos from two or more cameras, 
depth parameters are obtained (i.e.. three-dimension hke). Preferably but 
not Umitatively. when using at least two cameras of the same type, both 
10 turn aside and/or are elevated together, although the angle of perspective 
is different. Furthermore, the fact that the objects are obtained from at 
least two cameras, it enables to elongate the detection range, as well as to 
reduce the false alarm rate. Preferably, but not hmitatively, the distance 
between a pair of cameras is between 0.5 to 50 meter, the distance can be 
15 horizontally, vertically or at any an^e. 

Fig. 3 is a flow chart that shows an example of the program algorithm of 
system 10 (Fig. 1) for monitoring the desired area by using two IR 
cameras, according to a preferred embodiment of the present invention. 
20 The flow chart starts at block 31. wherein the initial definitions for the 

scanning and the processing are set. The initial definitions are parameters 
that are required for tiie operation of ^tem 10. For example, one or more 
parameters ti^t define tiie camera model, tixe initial camera an^e. 
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definition regarding the area (such as, loading the airport map or mihtary 
base map), etc. In the flow chart blocks 32 to 34 and block 38 describe the 
implementation of ihe graph description in Fig. 2. At the next step, block 
32, the computerized system 15 orders tiie motion controllers 14 to change 
5 the angle of the one or more camera. Then in the next step, block 34, the 
computerized system 15 orders the cameras (via motor controller 14) to 
take the sequence of photos, preferably about 25 to 30 photos a second. 
The photos are stored in tiie memory 151 (Pig. 1) as shown by block 38. 

10 At the next step 33, the data of the photos are processed; this step is part 
of the evaluation programs. The data processing in step 33 is performed in 
two stages. Firstly, pixel processing is performed and then, secondly, 
logical processing is performed. Both data processing stages, the pixel ajad 
the logical, will be described hereinafter. 



At the next step 36, which is also part of the evaluation programs, after 
the processing has been completed, computerized system 15 decides 
whether a detected object is a dangerous object. If a dangerous object is 
detected, then at the next step 35, a warning signal is activated, such as 
20 showing the location of the object on the monitor 18 (Fig. 1), activating an 
alarm, etc. Jf computerized system 15 makes a decision that no dangerous 
body exists, then in the next step 37, the last process data is stored in a 
related database. The stored data is used for updating the aforementioned 



15 
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background space. The background space is used during the pixels 
processing stege, in order to exclude from each processed photo one or 
more objects which are non-dangerous bodies but appear to be during 
detection. For example, the entire region that is covered by a tree that 
5 moves when the wind blows is excluded from the photo. 

As aforementioned, the data processing (block 33 of Fig. 3) is done in two 
stages. The following is a description of the two processing stages: 
- In the pixels processing stage, each pixel in each photo from the 
10 sequence of photos is mathematically processed from each camera that 
provide photos at same time period (e.g., as shown by elements 331 and 
332 of Fig. 4A). The mathematical process is based on Gaussian curve 
(Fig. 6) that is generated from a continuous measurement of pixels 
from previous photos, wherein the location of each pixel of the current 
15 photo is compared with a threshold value (e.g., threshold 61 as shown 
in Pig. 6) that is dynamically calculated along the operation of system 
10. The threshold value dynamically corresponds to the danger degrees. 
The pixels processing detects either moving objects or static objects, as 
described hereinafter regarding Figs. 5A and 5B. After the 
20 mathematical process is done, and one or more suspected dangerous 
objecte are. detected (i.e., pixels tiiat their location on the Gaussian 
curve exceed tiie current threshold), a tiiree-dimension (3-D) like data 
on the suspected object is calculated by system 10. The 3.D like data 
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represents furtiier parameters regarding the suspected object. The 3-D 
like data is generated from at least two cameras, by using the 
triangulation method (e.g., the distance of the suspected object is 
calculated from the parameters of the distance between the two 
cameras and the angle of each camera from which the 2-d photo has 
been taken). The 3-D data is - used for detectmg pixels that may 
represent objects such as, a relatively small or distant dangerous body, 
a part of a larger or closer dangerous body in a photo etc. For example, 
a bird in a flock of birds may appear as a single pixel in the photo, but 
due to their direction of flight, system 10 defines them as birds, even if 
each of the birds appears as a single pixel. In addition to the above 
mathematical calculation method, whenever there are suspected 
dangerous objects on the ground, system 10 find their location by 
comparing the photo of the suspected object with the previous stored 
image of that- specific area. According to the calculated difference 
between those photos at the region of the suspected object, system 10 
will determine if the suspected object is a dangerous object, or not. In 
addition, objects which will disappear or will not have logical path, will 
be rejected as false alarms. 

- In the logic processing stage, the detected pixels that may represent a 
dangerous object (i.e.. the suspected objecte) are measured by using 
different parameters, in order to decide whether they are dangerous or 
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not. The measured parameters are compared to a predetermined table 
of values that corresponds to the measured parameters. The 
predetermined table of values is stored in memory 151 or other related 
database. For example the measured parameters can be: 

5 1. The dimension of the suspected object, its length and its width (e.g., 
length = 3 pixels and width = 2 pixels), if it size is more then one pixel. 
An object can be an adjacent group of pixels. 
2. The track of the suspected object in relation to the monitored area, 
as were created in the logic matrix. 

10 3. Movement parameters, such as direction that was created from one 
or more pixels, velocity etc. 

According to a preferred embodiment of tiie invention, in case system 10 
detects one or more dangerous objects, at least one camera stops scanning 
15 the area and focuses on tiie detected dangerous objects. In addition to the 
storing of the taken photos, during the detection process at tiie data 
processing stage (block 33 of Fig. 3) the system also stored an event 
archive in the memory of system 10. The event archive contains data 
and/or photos regarding tiie dangerous objects tiiat were detected. 



20 



Fig. 5A schematicaUy iUustrates tiie detection of a moving object at tiie 
pixel processing stage. accordSng to tixe preferred embodiment of tiie 
invention. The detection of a moving object is done as follows: 
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- Each taken photo 401 to 430 from the current sequence is compared to 
an average photo 42. Photo 42 is an average photo tiiat was generated 
from the previous stored sequence of photos tiiat was taken at the exact 
camera angle as the current taken sequence of photos 401 to 430. 
5 . A comparison sequence of photos 451 to 480 is generated from the 
difference in the pixels between the average photo 42 and each photo 
from the current sequence of photos 401 to 430. Each pixel in photos 
451 to 480 represents the error value between photos 401 to 430 and 
photo 42. 

10 - Each error value is compared to a threshold level 61 (Fig. 6) in the 
threshold calculation unit 48. The threshold level 61 is dynamically 
determined to each pixel in the photo matrix statistically according the 
previous pixel values stored in the statistic database 47. Whenever a 
pixel value in each error photo 451 to 480 exceeds the predetermined 
15 threshold level 61. the location of the exceeded pixel is set to a specific 
value in a logic matrix 49 that represent the suspected photo (e.g., the 
pixel is set as value of 255, wherein the other pixels value is set to 0). 
- After the completion of the threshold stage for the entire current 
sequence of photos, the generated logic matrix 49 that contains the 
20 suspected pixels is transferred to the logic process stage, wherein the 
suspicious pixels are mejasured as described hereinbefore. 
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Big. 5B schematicaUy iUustrates the detection of a static object at the pixel 
processing stage, according to the preferred embodiment of the invention. 
The detection of a static object is done as foUows: 

. An average photo 42 is created from the current sequence of photos 401 
to 430. 

- A derivative matrix 43 is generated from the average photo 42. The 
derivative matrix 43 is used to emphasize relatively smaU objects in the 
photo, which might be potential dangerous objects. The derivative 
eliminates relatively large surfaces from the photo, such as shadows, 
fog etc. 

- The generated derivative matrix 43 is stored in a photo database 44 
(e.g.. memory 151 or other related database), and it is also compared 
with * previous derivative matarix, stored in database 44, of a photo 
that was taken from the exact camera angle of the current photo. From 
the comparison, an error photo 45 is generated. Each pixel in photo 45 
represents the error value between matrix 43 and the matidx from 
database 44 that it was compared to. 

- Each error value is compared to a threshold level 61 (Fig. 6) in the 
threshold calculation unit 48. The threshold level 61 is dynamically 
determined to each pixel in the error photo 45, statistically according 
the previous corresponding pixel values stored in tiie statistic database 
47. Whenever a pixel value in the error photo 45 exceeds the 
predetermined threshold level 61, the location of tiie exceeded pixel is 



13579/01 ^ 

- 26 - 



set to a specific value in the logic matrix 49 (e.g., the pixel is set as 
value of 255, wherein the other pixels value is set to 0). 
- After the completion of the threshold stage for the entire error photo, 
the generated logic matrix 49 that contains the suspected pixels is 
transferred to the logic process stage, wherein the suspicious pixels are 
measured as described hereinbefore. 

Of course, the method and apparatus of the present invention can be 
implemented for other purposes, such as for the detection of dangerous 
objects approaching the coast line from the sea. In this case, the approach 
by someone swimming or by a vessel such as boat traveling on water can 
be detected. The system 10 traces the path of the dangerous objects and 
its foreseen direction, and preferably sets off an alarm whenever a 
dangerous object approaches the coast line. In this implementation, the 
authorized bodies can be. for example, a navy boat that patrols along a 
determined path. 

In another example, system 10 is used for detecting burning in coal 
stratum. Sometimes burning in a coal stratum or pile occurs beneath the 
coal stratum or piles. This is usviaUy hard to detect. When the surface area 
of the stratum or pile heats up by emitting warm air. an IR camera such 
as those used by the present invention can easily detect. Whenever such 
burning occurs, it is desirable to detect the burning at the very start. The 
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implementation system 10 for detecting burning in coal stratum will allow 
the detection of combustion at the burning at the very beginning, 
pinpointing the exact location at which it occurs, its intensity, the size of 
the burning area, the spread direction of the burning, the rate of the 
5 spreading etc. 

The above examples and description have of course been provided only for 
the purpose of illustration, and are not intended to hmit the invention in 
any way. As will be appreciated by tiie skilled person, the invention can be 
10 carried out in a great variety of ways, employing more than one technique 

from those described above, all without exceeding the scope of the 

invention. 
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CLAIMS 

1. Method for the monitoring of an environment, comprises the steps 
of: 

a) procuring, adjoxirning and storing in a memory files representing 
the background space; 

b) defining and storing in a memory programs for processing data 
obtaiaed fi:om the observation of objects, for identifying said 
objects and determining whether they are dangerous; 

c) determining and storing parameters according to which the 
observation of the controlled space is effected; 

d) carrjdng out photographic observation of the controlled space or 
-sections thereof, according to the aforesaid observation 

parameters; and 

e) processing the digital data representing said photographs, to 
determine whether possible dangerous objects have been 
detected, and if so, dassifying said objects according to the stored 
danger parameters. 



2. Method according to claim 1, further comprising: 

a) changing the sections of the said photographic observation 
^ so as to monitor the path of any detected dangerous 

objects; 
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b) receiving and storing the data defining the positions and 
tiie foreseen futiire path of all authorized bodies; 

c) extrapolating the data obtained by monitoring the path of 
any detected dangerous objects to determine an assumed 
future path of ssdd objects; and 

d) comparatively processing said assimied future path with 
the foreseen future path of all authorized bodies, to 
determine the possible danger of collision or intrusion. 

3. Method according to any of claims 1 or 2, further comprising 
determining an action on dangerous objects that will eliminate the 
danger of collision, inixusion or damage. 

4. Method according to claim 3, wherein the action is the destruction of 
the dangerous object. 

5. Method according to daim 3, wherein the action is change in their 
assumed future path the dangerous object. 

6. Method according to claim 2. further comprising determining an 
action on an authorized body that will eliminate the danger of 
collision, intrusion or damage. 
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7. 



8. 



Method according to claim 6, wherein the action is a delay in their 
landing or take-off of the aircraft or a change of their landing or 
take-off path. 

Method according to claim 1, further comprising giving alarms 
signaling the presence and nature of any dangerous objects, the 
danger of collisions and possible desirable preventive actions. 



9. Method according to claim 1, wherein the photographic observation 
10 is carried out by performing the steps of: 

a) modifying the angle of one or more photographic devices, the 

entire mo; 

b) - photographing one or more photos with said photographic device; 

c) processing said photographed one or more photos by a 
15 computerized system; and 

d) repeating steps a) to c). 



10 



Method according to claim 9. wherein the photographic observation 
is carried out as a continuous scan or segmental scan. 



20 



11. 



Method according to claims 1 and 9, wherein the processing of the 
N digital data comprising the step of: 
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a) setting initial definition for the photographic observation and 
for the processing of the data of said photographic 
observation; 

b) storing in the memory the data that represent the last 
photographed one or more photos at a specific angle of the 
photographic devices; and 

c) processing said data for detecting suspected objects, by 
performing, firstly, pixel processing and secondly, logical 
processing; and 

d) deciding whether said suspected object is a dangerous object. 



12. Method according to claim 11, wherein the pixel processing 
comprising the step of: 

a) Mathematically processing each pixel in a current photo for 
detecting suspected objects; and 

b) Whenever a suspected object is detected, at least two 
photographic devices, being positioned verticaUy one above 
the other in distance fi*om each other, provides photos at 
same time period and same monitored section, generating 
data regarding said suspected object firom at least said two 
photographic devices, said generated data is a 3-D data. 
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13. Method according to daim 12, wherein whenever the pixel 
processing detects moving object, it comprises the steps of: 

a) comparing each current photo to an average photo that was 
generated from the previous stored photos that was taken at 

5 the exact camera angle as said current photos; 

b) generating a comparison photo from the difference in the 
pixels between said average photo said current photo, each 
pixel in said comparison photo represents an error value; 

c) comparing each error value to a threshold level, said 
10 threshold level is dynamically determined to each pixel in the 

photo matrix statistically according the previous pixel values 
stored in the memory as a statistic database; 

d) - whenever a pixel value in said comparison photo exceeds said 

threshold level, generating a logic matrix in which the 
15 location of said pixel value is set to a predetermined value; 

and 

e) upon completing comparmg each error value to said threshold 
level, for the ehiare current photos, transferring said 
generated logic matrix to the logic process stage. 

20 

14. Method according to daim 12. wherein whenever the pixel 
^ processing detects static object, it comprises the steps of: 
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0 Generating an average photo from the current one or more 
photos; 

g) generating a derivative matrix from said average photo for 
emphasis relatively small objects at each photo from said one 

5 or more photo, which might be potential dangerous objects; 

h) storing said derivative matrix in the memory as part of a 
photo database, and comparing said derived matrix with 
previous derivative matrix stored in said memory as part of 
said photo database, said previous derivative matrix is 

10 derived from one or more photos that was taken from the 

exact photographic device angle as of said average photo; 
i) From the comparison, generating an error photo, wherein 
• each pixel in said error photo represents the error value 
between said derivative matrix and said previous derivative 

15 matrix; 

j) comparing the value of each pixel from said error photo to a 
threshold level, said threshold level is dynamically 
determined to each pixel in the error photo statistically 
according the previous pixel values stored in the memory as a 
20 part of a statistic database; 

k) whenever a pixel value in said error photo exceeds said 
V threshold level, generating a logic matrix in which the 
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location of said pixel value is set to a predetermined value; 
and 

1) upon completing comparing each error value to said threshold 
level, for the entire current photos, transferring said 
generated logic matrix to the logic process stage. 

15. Method according to claim 11, wherein the logic processing 

comprising the step of: 

a) measuring parameters regarding the pixels in the logic 

matrix; 

b) comparing said measured parameters to a predetermined 
table of values stored in the memory, whenever said 

. measured parameters equal to one or more values in said 
table, the pixels that relates to said measurement are 
dangerous objects. 



16. 



Method according to claim 15, wherein the parameters are selected 
from the group consisting of the dimension of a adjacent group of 
pixels, the track that one or more adjacent pixels created in the logic 
mataix, direction, speed, size and location of an object that is created 
from a group of pixels. 
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17. Method according to daim 1, wherein the photographic observation 
is taken from at least two cameras. 

18. Method according to claim 17, wherein the cameras positioned with 
the same view angle are located at a distance of 0.5 to 50 meters 
from each other. 



19 



Method according to daim 18, wherein the cameras positioned with 
same view angle are installed on the same pole. 



20. Method according to any of daims 18 or 19. wherein the cameras 
positioned with same view angle are being rotated thus their view 
an^le is changed simxiltaneously. 

21. Method according to any of claims 17 to 20. further comprising 
providing at least one encoder and at least one reset sensor for 
determining the angle of eadi camera, said encoder and reset sensor 
are provided to each axis that rotates a camera. 



22. 



Method according to daim 21, wherein the reset sensor provides the 
initiation angle of the camera at the beginning of the scanning of a 
^ sector and the encoder provides the current an^e of the camera 
during the scanmi^ of the sector. 
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23. Apparatus for the monitoring of airfield runways , which comprises: 
a) photograpHc devices for carrying out photographic observation 
of the controlled space or sections thereof; 
5 b) a set of motors for dtianging the sections of the said photographic 

observation; 

c) elaborator means for processing the digital data representing the 
photographs taken by said photographic devices 

d) memory means for storing the digital data representing said 
10 photographs and the results of said processing. 

24. Apparatus according to claim 23, wherein the photographix: devices 
comprise one or more CCD camera and/or one or more infrared 



15 



20 



cameras. 



25. Method according to claims 1 and 2. further comprising 
documenting the activities of the wildlife and other dangerous 
objects, for preventing and reducing from said wildlife and said 
other dangerous objects to appear at the monitored area. 



26 



Apparatus according, to claim 24, wherein the distance, in an angle, 
V between each two cameras located on the same pole is between 0.5 



to 50 meters. 1\mat%> 
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